Distributed Scientiic Data Processing Using the Dbc
نویسندگان
چکیده
The Distributed Batch Controller DBC supports scienti c batch data processing The DBC dis tributes batch jobs to one or more pools of workstations and monitors and controls their execution The pools themselves may be geographically distributed and need not be dedicated to process ing batch jobs We describe the use of the DBC in a large scienti c data processing application namely the generation of atmospheric temperature and humidity pro les from satellite data This application shows that the DBC can be an e ective platform for distributed batch processing It also highlights several design and implementation issues that arise in distributed data processing systems
منابع مشابه
Scienti c Data Processing Using the DBC 1
The Distributed Batch Controller (DBC) supports scientiic batch data processing. The DBC distributes batch jobs to one or more pools of workstations and monitors and controls their execution. The pools themselves may be geographically distributed, and need not be dedicated to processing batch jobs. We describe the use of the DBC in a large scientiic data processing application, namely the gener...
متن کاملThe Dbc: Processing Scientiic Data over the Internet
We present the Distributed Batch Controller DBC a system built to support batch processing of large scienti c datasets The DBC implements a federation of autonomous workstation pools which may be widely distributed Individual batch jobs are executed using idle workstations in these pools Input data are staged to the pool before processing begins We describe the architecture and implementation o...
متن کاملThe DBC : Processing Scienti
We present the Distributed Batch Controller (DBC), a system built to support batch processing of large scientiic datasets. The DBC implements a federation of autonomous workstation pools, which may be widely-distributed. Individual batch jobs are executed using idle workstations in these pools. Input data are staged to the pool before processing begins. We describe the architecture and implemen...
متن کاملThe DBC: Processing Scientific Data Over the Internet
We present the Distributed Batch Controller (DBC}, a system built to support batch processing of large scienti$c datasets. The DBC implements a federation of autonomous workstation pools, which may be widely distributed. Individual batch ,jobs are executed using idle workstations in these pools. Input data are staged to the pool before processing begins. We describe the architecture and impleme...
متن کاملA New Paradigm for Scientiic Visualization
We outline the design of a scientiic visualization system based on a data card display invariant to provide information on the creation and processing of tasks in distributed task pool algorithms. Information aggregates over the tasks and processes are incorporated via non-classical histogram representations showing the distribution of the data within individual bins and by user-controllable tr...
متن کامل